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Abstract 

Initial  development  of  the  multi-directional  search  (MDS)  and  differential  evolution  (DE) 
optimization  methods  is  now  complete,  as  is  the  initial  user  interface  to  these  capabilities 
within  the  Analyst  V8.1  software  package  that  is  presently  in  “beta”  form.  The  8- 
processor  Linux  cluster  purchased  for  the  project  has  been  used  extensively  during  the 
past  few  months  to  test  the  optimization  system,  and  has  shown  excellent  performance 
with  floating  point  computation  rates  exceeding  4  GFLOPS  on  some  problems.  The 
cluster  has  also  recently  been  upgraded  to  64GB  of  system  memory,  allowing  solution  of 
significantly  larger  problems. 
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Executive  Summary 

The  following  items  have  been  accomplished  during  this  period: 

•  Qualification  of  Linux  cluster  at  STAR  is  finished.  Cluster  has  shown 
performance  above  4  GFLOPS  on  distributed  LU  factorization. 

•  Preliminary  work  on  the  Analyst  user  interface  to  the  optimization  library  has 
finished,  with  the  initial  implementation  fielded  in  beta  form  in  version  8.1  of 
Analyst. 

•  Optimization  capabilities  have  been  successfully  applied  to  multi-variate  collector 
problems  using  MICHELLE,  and  also  to  driven-frequency  optimizations  using  the 
Analyst  DFEM  solver. 

Qualification  of  Linux  Cluster 

We  have  run  many  tests  on  the  system  as  originally  configured  (with  4GB  of  system 
memory  per  processor),  and  it  has  proved  to  be  quite  stable.  Although  the  1GB 
interconnect  is  relatively  slow  (by  typical  cluster  standards),  for  most  problems  it  is  not  a 
significant  factor  in  the  overall  performance  of  the  system. 

We  recently  upgraded  the  memory  to  8GB  per  processor  (bringing  the  total  system 
memory  to  64GB),  and  subsequent  to  the  upgrade  the  system  has  been  less  reliable,  with 
nodes  going  down  on  occasion.  This  appears  to  be  due  to  a  combination  of  factors  that 
include  one  or  more  bad  memory  chips,  and  an  air-conditioning  problem  that  resulted  in 
slightly  warmer  temperatures  in  the  machine  room  during  part  of  the  testing  period.  We 
temporarily  took  4  processors  offline  (still  with  a  total  memory  of  32GB),  while  the 
remaining  processors  were  either  powered  down  or  being  used  to  test  memory. 

We  are  now  in  the  process  of  sequentially  testing  all  of  the  memory  chips,  and  have  also 
addressed  the  air-conditioning  problem.  The  cluster  is  presently  back  to  6 
processors/48GB  memory,  and  we  expect  to  have  all  eight  processors  at  full  memory 
within  the  next  few  days. 

Optimization  User  Interface 

Implementation  of  differential  evolution,  multi-directional  search,  and  a  gradient-based 
zero-crossing  algorithm  is  now  complete.  The  optimization  controller  can  also  be  used  to 
perform  parameter  sweeps  in  which  the  goal  function  is  evaluated  and  reported  for  a  set 
of  parameter  vectors  in  a  user-specified  range. 

The  basic  user-interface  to  the  optimizer  is  also  complete,  with  the  panels  shown  in  our 
previous  progress  report  now  fully  implemented.  It  consists  of  a  set  of  “wizard”  panels 
that  walk  a  user  through  the  setup  process.  The  optimization  process  relies  heavily  on  the 
embedded  Python  system:  Python  scripts  are  used  to  define  the  goal  function  and 
constraint  functions  (see  Fig.  1-2),  and  later  we  plan  to  add  support  for  specifying  a  user- 
defined  optimization  algorithm  in  a  Python  script.  User  can  edit  the  existing  scripts,  or 
add  new  ones  as  necessary. 

Once  the  optimization  is  started,  a  dialog  is  displayed  that  shows  the  real-time  progress  of 
the  process  on  several  different  tabs  (see  Fig.  3).  The  best  case  is  retained,  while  all  other 
cases  are  deleted  after  each  iteration  to  avoid  accumulation  of  unnecessary  files  and  data. 
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Moreover,  the  complete  history  of  the  parameter  vectors  and  resulting  metric  values  for 
an  optimization  can  be  copied  from  the  Experiment  Details  panel  of  the  Status  dialog  and 
pasted  into  an  Excel  spreadsheet  for  review  or  further  manipulation  (such  as  curve-fitting 
of  other  analysis). 

Early  Experience  with  Optimization  System 

The  optimization  system  has  now  been  used  on  several  different  types  of  problems,  and 
both  MDS  and  differential  evolution  appear  to  be  functioning  properly.  On  multivariate 
problems  for  which  there  are  a  lot  of  local  minima,  differential  evolution  generally  does  a 
better  job  of  finding  an  optimum  value,  but  it  takes  longer  to  converge  than  MDS.  Both 
approaches  require  a  significant  number  of  analyses,  with  problems  involving  several 
parameters  often  taking  several  hundred  or  more  function  evaluations.  Since  a  single 
metric  function  evaluation  can  take  a  few  minutes  to  a  few  hours  time  to  perform,  the 
overall  time  required  to  do  an  optimization  can  be  days  to  weeks.  Because  of  this,  we  are 
looking  at  ways  to  improve  the  efficiency  of  the  algorithms,  including  the  use  of  local 
functional  approximations  to  the  metric,  and  space  mapping  wherein  low-accuracy 
(coarse  mesh)  solutions  can  potentially  be  used  more  effectively  in  an  optimization. 

Next  Phase 

Work  in  the  next  3  months  will  include: 

•  Incorporation  of  feedback  on  the  optimization  system  from  beta  users  into  both 
the  user  interface  and  algorithm  development. 

•  Work  on  space-mapping  or  related  methods  for  utilizing  models  of  varying  levels 
of  approximation  within  an  optimization. 

•  Study  of  collector  optimization  strategies  using  the  software  with  individual(s) 
from  industry. 
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Fig.  1.  Optimization  panel  used  to  select  goal  function  and  set  any  associated  parameters.  User  picks  the 
goal  function  to  be  used  in  the  optimization.  All  goal  functions  are  Python  scripts  that  can  have  an 
arbitrary  number  of  parameters.  We  have  created  a  set  of  standard  goal  functions,  and  users  can  add 

their  own  functions  as  needed. 


def  Evaluate (params , case, metricparam) : 
try: 

TargetCurrentParam  =  params . GetParameterByName (g_sTargetCurrent) 
dTargetCurrent  =  star . PySDoubleParameter (TargetCurrentParam) .GetValueO 
db  =  star . PyORDoc (case . GetPostProcessor ( ) ) . GetDatabase ( ) 

iO  =  db.GetIteration(db.GetNumIterations ( ) -1) 

mat  =  star . PyORQRMatrixObject (iO . GetQuantityResult (3 ) ) 

matv  =  mat . AsArrayObj  ect ( ) 

nNumRows  =  mat . GetNumRows ( ) 

print  matv [nNumRows  -1] [1] 

fMetric  =  ( dTargetCurrent-matv [nNumRows  -1] [ 1 ]) /dTargetCurrent 
metricparam . SetValue ( fMetric ) 

except : 

metricparam. SetValue (1000000) 
return 

Fig.  2.  Example  goal  function  script.  This  script  computes  the  difference  between  the  gun  current 
output  by  MICHELLE  and  a  target  value.  User  can  create  arbitrarily  complicated  metric  functions  in 
Python  and  then  install  them  into  Analyst  for  use  in  optimization. 
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Fig.  3.  This  panel  is  displayed  while  the  optimization  is  in  progress.  Results  for  each  iteration,  and  for 
each  individual  experiment  (analysis)  can  be  found  on  the  corresponding  tabs.  The  optimization  may 

also  be  aborted  from  this  panel  if  necessary. 
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